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Abstract 

Consider the sum Z — X^^Li ^n(?7n — ¥.rj n ), where rj„ are i.i.d. gamma random variables with shape 
parameter r > 0, and the A„'s are predetermined weights. We study the asymptotic behavior of the tail 
X^^Lm X n (rj n — Et7„) which is asymptotically normal under certain conditions. We derive a Berry-Essen 
bound and Edgeworth expansions for its distribution function. We illustrate the effectiveness of these 
expansions on an infinite sum of weighted chi-squared distributions. 

1 Introduction 

Consider a random variable given in terms of an infinite sum: X^^Li ^niVn ~^Vn)i where rj n are i.i.d. gamma 
random variables with mean Er/ n = rO and variance Var rj n = r0 2 , where r > and 6 > are the shape and 
scale parameters, respectively. We may suppose without loss of generality that 6 = v , by incorporating 
the extra parameter into the constants A„ . We thus consider 



z = ^\ n {n n -i), (l) 

n=l 

where rj n are i.i.d. gamma with pdf 

fvA*) = ^-f r - 1 e- rx , x>0 (2) 

where r > 0. We suppose that {A„} is a non-increasing sequence of positive numbers such that y] X„ < oo 
and are normalized so that 



1 

r 

With this setup, Z has mean zero and variance 



E A n = 1 - (3) 



oo 00 \ 2 

VarZ = ]T A^Var(r?„ - 1) = ]T -f = 1. (4) 



r 

n—l n—1 



Of particular interest is the case when A„ = n ^£(n), where 7 > 1/2 and £ is slowly varying as n — > 00. The 
restriction 7 > 1/2 ensures ^ A^ < 00 but allows for cases when either Y] X n = 00 or X n < 00. 
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Random variables of the from (JTJ make up a rich class of distributions. Indeed, consider the double 
Wcincr-Ito integral 

/= / H(x,y)Z(dx)Z(dy) (5) 

where Z is a complex- valued Gaussian random measure. The double prime on the integral indicates that 
one excludes the diagonals {x = ±y} from the integration (for more on integrals of this type, see [H]). In 
[7], Proposition 2, Dobrushin and Major show that the random variable I can be expressed in the form (JTJ) 
with r = 1/2 (chi-squared distributions). An important example in this case is the Rosenblatt distribution, 
discovered by M. Rosenblatt in [13] , and later named after him in [18]. For an overview, see [17] • Properties 
of the Rosenblatt distribution are further developed in |19j using the results we obtain in the present paper. 

A major difficulty that arises with distributions like ((TJ) is that there is no closed form for its distribution 
function or density function. To make matters worse, even the characteristic function of Z is not easy to 
express or compute numerically. An initial approach to this problem might be to truncate the sum ([T]) at a 
level M > 1, and write Z — Xm + Ym where 

M-l oo 
n = l n=M 

and using Xm as an approximation of Z since it is a finite sum of weighted gamma distributions (an 
efficient method for computing the PDF/ CDF of such a distribution can be found in [20]). How good is this 
approximation? This question can be partially answered by looking at the variance of Ym , 

^ oo 

a 2 M ee VarY M = - E A »- ( 7 ) 

n=M 

Depending on the decay of A n , this can tend to slowly. For instance, if A„ ~ CVi~ 7 for some 7 > 1/2, then 

/ 1 r-OO 

a M ~- x-^dx^-M 1 - 2 ^, 
r Jm r 

which tends to slowly when 7 is close to 1/2, and thus in these cases M would have to be taken very large 
for Xm to be a reasonable approximation. 

Instead of approximating Z by only Xm for M large, we will instead show when Ym is asymptotically 
normal using a Berry-Essen estimate, and then we will give an Edgeworth expansion for the distribution 
function of Ym- Combining this with the distribution of Xm will provide a method for computing the 
distribution function of Z . This fact can also be used for simulation of the random variable Z by simulating 
Xm exactly, and approximating the error with a N(0, a M ) random variable. 

This paper is organized as follows. In Section (5] we give the characteristic function of Z and Ym in 
Levy-Khintchinc form. We then use this form of the characteristic function to show Ym is asymptotically 
normal in Section [3] To approximate the CDF of Ym, we prove an approximation lemma in Section [5] and in 
Section [5] we give an Edgeworth expansion. Finally, we demonstrate the accuracy of these approximations 
in Section [6] on an example where the r\ n are chi-squared, and the sequence A„ is given. 

2 Levy-Khintchine representation 

Recall that a random variable X is infinitely divisible if for any positive integer n, one can find i.i.d. random 
variables A"i.„, A"2.„, . . . , X n ^ n such that 

X = X\ n + Xi.n + ' • • + X ntn 
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The characteristic function of any real valued infinitely divisible random variable X with EX 2 < oo can be 
expressed in the following form, known as the Levy-Khintchine form. 

Ee mX = exp ( iau - -u 2 a 2 + f (e iux - 1 - iux)U(dx) ) (8) 

V 2 Mw J 

where a € R, a 2 > and IT is a measure on R \ {0}, known as the Levy measure, which satisfies 

min(x 2 ,l)n(da;) < oo. (9) 



/ 

JR\{0} 



For background on such distributions see [16], [14], [4], or [2]. 

The random variable rj with PDF ^ is infinitely divisible and has characteristic function 

Ee mr > = exp Qf (e mx - l)n(x)J (10) 

where the Levy measure is given by H(dx) = rx~ 1 e~ rm dx for x > ([2], example 1.3.22). Hence, if A > 0, 
the random variable A(ry — 1) is also infinitely divisible and its characteristic function is given by 

Eexp(wA(r?- 1)) = exp (J^ {e lux - 1 - iux) (~ exp (~y)) • (H) 

By taking an infinite sum of such distributions as in ([T]), it is not surprising that the resulting distribution 
is also infinitely divisible as indicated in the following proposition. 

Proposition 2.1 The characteristic function of Z defined in (QP is given by 

Ee iuZ = exp (e lux - 1 - iux)v(x)dxj (12) 

where v is defined as 

■<*)-iE-p(-y- ^ 

n—l x ' 



Proof. We have 



Ee luZ = lim Ee iuXM 

M-»oo 



- E ^(^r (ete - i ~ M (iS" p ("S)j <fa j- (M) 

To pass the limit through the integral above, note that \e zux — 1 — iux\ < \u 2 x 2 and thus it suffices to show 
(using the dominated convergence theorem) that 



r r°° ~ f rx\ 
- 2 J *|> P (-^ 



<oo. (15) 



This follows since 



/•oo 00 f rx\ °° A 00 f rx\ °° A 2 

u n— 1 v 7 n—l u x ' n—l 



< OO. 
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Thus US]) holds and hence the Levy measure is given by (fTTfl) . 



The form (|12[) of the characteristic function will be useful when we study the Edgeworth expansion of 
the tail Ym defined in ©, whose Levy measure is given by v( M \x) = rx~ Y Y^Lm cx P ( — x^) • 

3 Berry-Esseen Bound 

In this section we show that under certain conditions on the sequence X n , then the distribution of the tail Ym 
is asymptotically normal as M — > oo. A Berry-Esseen type bound for infinitely divisible random variables 
was studied in [3], and we will apply a similar method to the random variable Ym- 



Consider the normalized distribution Ym = o~ M Ym where ctm is defined in (JT]) and let 



n=M 



rxa M 



A,, 



x > 



(16) 



be the density of the Levy measure of Ym- As the remark below indicates, Ym = o~ M Ym docs not always 
converge to a normal distribution. To determine whether Ym is asymptotically normal, it suffices to consider 
the third cumulant of Ym which we denote by 



K 3,M 



/•OO ^ />oo ^ 

/ x^ M \x)dx = r V / I 2 e- ra "/ A "& = 2rVE A 

JO n=M " 



(17) 



n=M 



The following theorem uses a Berry-Esseen bound to show Ym is asymptotically normal if k^.m — > 0. The 
constant 0.7056 appearing in this bound is the smallest known to date, see [15] . 

Theorem 3.1 Let Z be given by (QJ) and suppose the sequence A„ is such that 

oo 

E A » 



E A n 



3/2 



as M — > oo. 



(18) 



\n=M 



Then, Ym — > N(0, 1) as M — > oo and we /iawe 



sup 



P[Y M < x]-$(x) 



< 0.7056 k 3 ,m 



where $ is the standard normal CDF and k^^m is defined in J7 



(19) 



Remark: It can easily be checked that condition (jT5)) is satisfied if A„ decays as a power law, i.e. if 
A„ ~ Cn~ 7 for some 7 > 1/2. However (jTHJ) is no£ satisfied if A„ decays exponentially, and in this case 
convergence to N(0, 1) will not always hold. For example, suppose A„ = 2~" _1 . Then Ym = ^n(Vn — 1) = 

J2 ^nVn - J2^n> - J2 and SO 



°M Y M > 



v -1/2 
v2 I 



- 1 E ^ 



5> 



E 2 " 



/ 



\ 



-1 J2 2- 2 ™- 2 = -Vfr 



-M 



for all M. Since the normalized random variable o m x Ym is bounded below, it cannot converge in distribution 
to N(0, 1). 
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Proof. Since Ym is infinitely divisible, for each n > 1 we have 



Y* r - Y {n) -I- 

IM - i M1 + r M ,2 



M,n ' 



(20) 



where Y, 



(n) 



MA i 



1, 2, ... ,n are i.i.d. with mean and variance a M /n. Applying the Berry-Esseen Theorem 



(|S], Theorem 7.6.1) to the sum (|20|) . we have for any n > 1, 



sup |P [ctJ-Ym < x] - ${x) 



sup 

a:6l 



<JM\jn 



--{\fnY M ) < x 



3 



0.7056- 



0.7056 



M 



(21) 



Using Lemma 3.1 in [3], nE[cr iw I Y^ l j] 3 — > J °° a; 3 £'^ f ' ) (x)dx = m- Thus, we let ri —> oo in (|2T|) . which gives 



To see that the right hand side of this bound tends to as M — > oo, notice that by ([7]), 

-3/2 



K 3.M 



n=M \ n=M ) n=M 



(22) 



which tends to by the assumption (fl8| . implying convergence to N(0, 1). This finishes the proof. 



If A n ~ CrT 1 for 7 > 1/2, then k$,m — 0{M~ 1 / 2 ) (see ([26|) below), which describes the rate at which 
the right hand side of (fT9|) tends to 0. While it is nice to have a practical bound on the error made when 
approximating the CDF of Ym with that of a normal, this rate of convergence may be too slow. In the 
next section, we improve this approximation by using Edgeworth expansions. These will do a better job of 
approximating the CDF of Ym for small M , however it will no longer be easy to bound the error made in 
this approximation exactly. 



4 An approximation lemma 

The previous section showed that the tail Ym can be approximated by a normal distribution for large M. 
We shall improve the approximation to the CDF of Ym using an Edgeworth expansion. To establish the 
Edgeworth expansion, we will need a lemma involving an approximation of the characteristic function of Ym 
by a polynomial involving the cumulants. 

In the following sections, we will make the following assumption about the sequence A„: 



X n = £(n)n 7 

where 7 > 1/2, and £ is a slowly varying function at 00. With this assumption, ([3]) is satisfied and 



1 



•M 



M 



o, ^2 -2^ *(Af) 2 M 1 - 2 T 
l(nfn *rdn = f( . 



(23) 



(24) 
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Extending the definition of k^m in (|T7)) . we will denote all cumulants of Ym by (see [IB], Theorem 7.4), 

v*- l exp ( -H^pL ) 



/•oo />oo 

/ x k v (M \x)dx = r V] / x fc_1 exp 



n=M 

(fc-1)! 



An 



SEt fc>2. (25) 



Observe that k<i,m = 1 and as M — > oo, ([2U]) . ([2"4"|). ([2~5j) and properties of slowly varying functions imply 

K M/~^T^ [°° e(n) k n- k ->dn ~ C fe (€(M)~ fe M~^ _fc7) )(^(M) fc M 1 ~ A:7 ) 



CfeM 1 "*, fc>2 (26) 



for a constant Cfc. Notice that in particular, if fc = 3, then ~ C3M 1 / 2 , which implies condition (fl~8|) . 

In view of Proposition 12. 1[ the difference between the log of the characteristic function of Ym and that 
of a standard normal is given by the following function Im defined as 



I M (u) = J~ (e iux -l-iux- ^ M ){x)dx, 



(27) 



which can be rewritten as 

r°° . .... / ,i.2 \ 

(28) 



I M (u) = (e m * - 1 - iux)v {M) {x)dx - (- 



since J °° x 2 p^ m ^ (x)dx = K2,m = 1- A key step in developing an Edgeworth expansion is approximating the 
function e 1 "^ by a polynomial involving the cumulants, which is done in the following lemma. 



Lemma 4.1 For N > 3 and u > 0, we have as M — > 00, 

1 /(in) 



e I M (u) _ 



r,(JV) \m=3 m x 



~ K m,M 



.3N-3 

< Qn(u) 



u N _ 1 

exp I — «3,Af 

(29) 



(3\r-i(N-iy K ^ cxp ^T^ 7 



where rj(N) denotes all non-negative indices ks, foi, . . . , fcjy suc/i i/iai 

1 < fc 3 + 2fc 4 + ...(7V-2)fc A r < A r_2 (30) 

and |Qiv(w)| is bounded by a polynomial in u whose coefficients are as M — > 00. 

Remark: This bound is a complicated function of u, but this will cause no problem because in the proof of 
Theorem 15.21 below, this bound is multiplied by e~ u / 2 and integrated over u € [0,/%]^]. 

Proof. By using Taylor's Theorem on the function e mx for u > 0, we have for each N > 2, 

J w (u) = (e™* -l-iux- ^ M \dx) =J™(jt + fl "(ua;)^ t> (M) (dx) (31) 



G 



where R n is a remainder which satisfies 



\Rn(ux)\ < 



(ux) 



N+l 



(N + iy: 



Using the definition (|25j) of Kk,M, Im becomes 



JV 



v— » (in) ■■• 

Im(u) = } — K m ,M + Rn(u) 

* — * m 



m— 3 



where now, 



Notice that Im(u) = R-z{u), which follows from (|33| by setting N = 2. 
Turning now to exp(/jvf(u)), we apply the classical inequality 



' ~n 

T — 

n=0 



r+1 

< ^-e |z| , z€l, r > 
r! 



to exp(/jif(w)) and using (|3"3")1 . we get 



JV-2 



exp(/ A /(w)) - X] 



71 = 



< 



\Im(u)\ 



N-l 



< 



(N-l)\ 

\Mu)\ N ^ 
(N-iy. 

U 3(JV-1) 

(3!)JV=T(JV^T)! n ' 3 ' M 



cxp(|/ M (u)|) 
exp(|i? 2 ( U )|) 



K 3Jl/ ex P 



3! 



Thus, by adding and subtracting Y^n=i Ih '^ on the ^ er ^ band side of (|29|) . we have 



exp(7 M (w)) - 1 + 



N 



£ no 



1 /(w) r 



< 



iV-2 



exp(Ijvf(w)) - ^ 



jj(iV) \m=3 



/M(«) r 



fem! V ml 



JV-2 

E 

n=0 



I M (u) r 



N 



En 

ij(iV) \m=3 



1 /(iw) r 



fc m ! V m! 



(32) 



(33) 



(34) 



(35) 



(36) 



Notice (f3"5j) gives a bound for the first term in (|3"6")l . Thus, to finish the proof it remains to bound the second 
term in (|36|) . To do this, fix 1 < n < N — 2 and observe that ([32]) implies 



/V 



(«u) r 



m=3 



7/7! 



■ Km, Af + Rn(u) 



(37) 
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Applying the multinomial theorem, this becomes 
I M (u) n 1 



E 



{k m }r, 



k 3 ,k4,...k N ,k N+ i 



E 

{fc m }„ 



JV 



1 f{iu) r 



m— 3 



' K m,M 



' JV 

n 

m— 3 



(ra) r 



m! 



-K-m.M 



R 



JV 



N 



CjV+1 



(38) 



where {/c m }„ denotes all sets of non-negative integers k m , 3 < m < N+l such that k^ + k4 + - ■ - + kiv + kN+i = 
n. By (EH), Km, M = 0(1). Moreover, by {33J and (USD, |i?jv| < jj^^n+im ~ I ^ 5 J T Cjv+iM-( iV - 1 )/ 2 , 
thus any term in (|38[) involving i?/v (that is with fcjv +1 > 1) can be grouped into a function Q^ N (u) which 
is bounded by a polynomial with positive coefficients which are 0(M~^ N ~ 1 ^ 2 ). Doing this, (|38) becomes 



I M {u) n 



E 



JV 



On 



1 /(ut) r 



m— 3 



(39) 



where {fc m }^ denotes all fc m , 3 < to < JV such that /C3 + &4 + . . . fc^v = ti. In the remaining sum, the 
coefficients arc 

JV 



n 



i 



i, *m!(m!)*- m ' M ' 



(40) 



m— 3 



Using (f26) again, these coefficients are of the order 



n 



= ( M -MJ:m=3 mfe "«- 2 ^ m =3 fe ».]) 
= / M -M^=s™^-H N 



We shall now isolate the terms in the sum (|39|) for which 



JV 



mfc m > JV + 2n - 1. 



(41) 



(42) 



m— 3 



They form a polynomial Q^ N (u) whose coefficients by (|4"Tj) are of the order 



where we have used the fact that the k m 's are chosen to satisfy (|42|) . Thus, 



E 



1 /(iu) m \ fc " 

{fcm}^ Lm=3 x ' 



(2) 



(43) 



where {fc m }^ denotes all k m , 3 < m < N such that ^k m = n and X) ™fcm < N + 2n — 2. Notice that by 
combining these two inequalities, the fc m 's in this sum also satisfy 



JV 



^ (m - 2)fc m < (JV + 2n — 2) — 2n = JV - 2. 



(44) 



m=3 
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Now, returning to the second term in (|36[) . in light of (|43|) . we have 



JV-2 

E 



I M {u) n 



( JV-2 




E 




U=i 




/ JV-2 













1 f(iu) r 



k I 



-Km,M 



JV-2 
n=l 



" 1 /(w) 



(«) 



(45) 



where Qn(u) :— J2n=ilQnN( u )+QnN( u )} ^ s bounded by a polynomial in u whose coefficients arc 

As for the double sum on the right hand side of (|4"5"|) . observe that from (|4"4")l . this can be rewritten as the 

(single) sum over all ki, 3 < i < N such that 

1 < k 3 + fe 4 + . . . k N < N - 2 and 
k 3 + 2k& H h (iV — 2)fc w < N - 2. 

Since A:3 + k± + ■ ■ ■ + k^ < ^3 + 2/C4 + . . . (N — 2)k^; these two conditions are satisfied if and only if 

1 < fe + 2ki -\ \-{N- 2)k N < N - 2, 

which is the definition of i](N) in (|30[) . Thus, 



N-2 

E 



/m(«)" 



N 



,1 



En 



1 /(iu) r 



k I 

» in • 



-K m .M 



n=l V (N) m=3 

This bounds the second term in (|36|) and completes the proof. 



< |Qjv(u)|. 



(46) 



5 Edgeworth expansions 

Wc shall improve the approximation to the CDF of Ym using and Edgeworth expansion. A two-term 
Edgeworth expansion of a general sequence of infinitely divisible distributions are studied in |10j . We apply 
a similar method to our case, but with an Edgcwood expansion to any order. 

Given a CDF F of a random variable X and a function G (not necessarily a CDF) we let p denote the 
suprcmum norm of the difference F — G: 

p(F,G)=sup\F(x)-G(x)\ 

We can bound p(F, G) using the characteristic function of X and the Fourier-Stieltjes transform of G. This 
is done in the following lemma which is proved in [5], Lemma 12.2. 

Lemma 5.1 Let (j) be a characteristic function of a random variable X with CDF F. Let G be a function 
for which 

lim G{x) = 0, lim G[x) = 1, and sup|G"(a;)| < C, 

for some constant C and let g(u) = J R e mx dG(x) be the Fourier-Stieltjes transform of G. Furthermore, 
suppose that 



/ \x\dF(x) < oo and / \x\dG(x) 
Jr Jul 



< oo. 
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Then for every U > and t > to, 

p(F,G)<—± f U \ (j) (u)-g(u)\-+4th(t£ (47) 

4h(t) — 7r J u U 

where h and to are defined as 

, . . f sin 2 (a;) , „ , , . . n 

hit) = / i-^dx, t > 0, and h(t Q ) = -. 

Jo % 4 

This lemma involves two parameters t and U, which must balance each other (making U large decreases the 
second term on the right hand side of (|47| and increases the first, and t has the opposite effect). In our 
application, U will tend to infinity and t will be an unspecified constant. This lemma will be used to study 
the convergence of an Edgewood expansion for Ym- 

We can now state a theorem detailing the convergence rate of an Edgeworth expansion for the CDF of 
Ym as M — > oo. Recall the Hermite polynomials which can be defined as Ho(x) = 1 and 

H k (x) = (-l) k e* 2 /*-^e-* 2 /\ k>l, 
ax K 

see [9], page 157. A simple induction shows that Hfc also satisfies the recursion formula 

H k+1 (x) = -e* 2 / 2 ±(H k (x)e-* 2 / 2 ), k>0. (48) 

The first few H k are given by H\(x) = x, H2(x) — x 2 — 1, Hs(x) = x 3 — 3x,i?4(x) = x 4 — Qx 2 + 3, 
H 5 (x) = x 5 - I0x 3 + 15x, .... 

The following theorem provides an Edgeworth expansion of Ym up to an arbitrary order N > 2. 

Theorem 5.2 As M — > oo, for each N > 2 the CDF ofY M satisfies 



P[Ym < x] = $(x) 




N 



m— 1 



where $ and (f> denote the standard normal CDF and PDF, rj(N) denotes all non-negative indices k^, ki, . . . , fcjy 
such that 

1 < k 3 + 2k 4 + ...(N -2)k N < N-2 (50) 

and 

C(fci, . . . , k N ) = 3fc 3 + 4fc 4 + . . . Nk N - 1. (51) 
Moreover, the error 0(M~^ N ~ 1 '^ 2 ) is uniform for all x G M. 

For example, if JV = 2, there is no solution to (f5T)|) . If JV = 3, the only solution to ([50| is = 1. If 
N = 4, we have the additional solutions k 3 = 2, k^ = and k 3 = 0, fct = 1. Thus, for small values of N, the 
right hand side of ([4"9"]l becomes 
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N = 2 : P[f M < x) = $0) + 0(Ar 1/2 ) 



N = 3 : P[Y M < x] = §(x) ~ <t>{x)^^-K S ,M + O^/" 1 ) 



N = 4: P[Ym < x] = $(x) -</>(x) 
N = 5: P\Y M < x] = <S>(x) - <j>(x) 



H 2 (x) 

ir' 

g 2 (x) 

3! 



«3,M 
K 3,M 



H 3 (x) 
4! 



ff 6 (s) ,,2 



K 4,Af + 



(2!)(3!) 2 
#5 (a) 



3! '" J,J,J ' V 4! "" M " J ' (2!)(3!) 2 3,M 
g 4 (x) H 6 (x) , ff 8 (aQ 3 

K5 ' M + (3!)(4!) K4,MK3,M "(30^ K3 ^ M 



0(M- 3 / 2 ) 



+ 0(M" 2 ) 



A more revealing (but slightly more complicated) statement of Theorem 15.21 is 



iV 



P[Y M <x} = - <( E E 

n=3 W(n) 



A~! V m! / 



m— 3 



H C (k s ,..,k n )(x) }+0[M 



(52) 



where 77' (n) denotes all ka, £4, . . . , k^ such that £13 + 2k^ + • • • + (n — 2)/ctv = n — 2. In this form, it is clearer 
what additional terms appear in the expansion as you increase n from 3 to N. 

Proof of Theorem HT21 
Proof. Define G{x) as 



G{x) = $(x) - 4>(x) { E 



N 1 1 
k m \ \ ml J 



jn — 1 



-H'c(fc3,..,feiv)( a; ) 



(53) 



Then by (|48|) , we also have 



JY 



n( K m,M 



H, 



C(fc 3 ,-,fciv)+l 



Using this and the fact J R H k {x)4>{x)e lux dx = {-l) k J R (^<H^)) e^cfcc = (ra) fe e~ u2 / 2 , the Fourier-Stieltjes 
transform of G is given by 

g(u) = { e mx dG{x) 



-(-?)( 1+ S(ni(^r^ 



A' 



6xp "t 1+ E En 



1 /(m) r 



(54) 



77(A) \m=3 

where we have used the definition of £ in (|5T|) . Let <p( M >(u) be the characteristic function of Ya/: 



<^ (M) («) = cxp ( / (e mx - 1 - iux)V {M > {x)dx 



(M), 



(55) 
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Since N > 2, choose e > such that 



K 3,M < eK N+l,M 



for all M > 1 (this exists by (|26l) ). To show (|4l))) using Lemma fSTTl it suffices to show that 

rUM , du 



Jm 

where 



W {M \u) - g{u)\— = O (m-^" 1 )/ 2 ) , (56) 



C/m := e^+i,M ~ C w+1 A/-( 1 -^ i ) = Cn^M^ 1 (57) 

from (|26| . Notice that with this choice of Um, the second term on the right hand side of (|47|) is already of 
order 0{U^) = 0(A/~ (Ar ~ 1)/2 ) and thus we need to only bound J M - 
Using l[2"8]). notice that 

^ M \u) = exp (yj™{e mx ~ 1 " ius)^(a?)da?^ = exp (l M (u) - y) . 
Using this and the definition of g in (|54p. we can break up the integral Jm in (|56p as 

-Um / ..a\ / / _ /JV_ ! /( iu j«, N^XMdu 



Jm = I exp (-^-) exp(/ M (u)) - f 1 + W JJ JLj (^T K ^ 



7](N) \m=3 



II 



Jma + Jm,2 + Jm. 



3- 



where 



Jm,i - jf exp ^-y^ ( exp(I M (v)) - ^1 + g ( II 

/■ aM / u 2 A 
Jm,2 = i exp I — — + iivf (u) I — 

•> K 1 AT ^ / 



k ' 

,,(JV) \m=3 ™' 



1 ({iu) m \ km \ \ \ du 

— ; — H"m,M 



II 



3, a/ v 7 \ r?(W) \m=3 



II 



We will now show that Jm.i = 0(M ( N 1 ^ 2 ), i = 1,2, 3, which with the help of Lemma T5. 11 will imply 
the result. 

Estimate for Jm.i- 

From Lemma 14.11 we have that 



\Jm,i\ < I exp [ -y 



Qn ^ + (v\n-km_^\ k 3m cx p ir K3 < M 



du 
u 



where Qn is bounded by a polynomial in u whose coefficients are 0(M ( N 1 ^ 2 . Thus 

du ( u 2 \ u 3N ~ 4 



,-1 

L 3,M 



exp ( ~ ) \Qn(u)\ ^ + / exp ( ~ J —^-^-^ K^du, (58) 
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since on the interval < u < n 3 M , we have uk^m < 1 and 



cxp ( — — ) cxp ( —K 3tM ) < cxp 



The first term in (|55|) is 0(M ( N x ^ 2 ) since all coefficients of Qn are of this order. The second term in 
dSHD is also of order 0(M^ ( - N ^ 1 ^ 2 ) by (26]). Thus, J M ,i = 0(A/- (JV ~ 1)/2 ). 



Estimate for Jm.2- 

We will in fact show that J 2 m = o(A/~ (Ar ~ 1)/2 ). First, observe that 



Um ( u 2 \ du 

J 2 ,m| < I exp -— + Re[I M (u)] — . (59) 



3.M 



2 /J y u 

Thus, we must show the integrand tends to zero fast enough. Notice, using (|28)) . that 

poo 

Re[I M (u)} = - (1 - cos(ux))v {M} (x)dx 



9 

u 



2 

Using (Unj) , we compute this integral 



A M {u) := / (1 - cos(ux))z/ (M) (x)dx = r / (1 - cos(us)) V 

J ° J° Ktti x ) 

OO p qq / \ oo poo pu 

= / ° SW e— "/ A "dx = r ]T / / sin(ta) e -— / A "cftdx 

°° nil / pOO \ °° pU ( f \ 

r £ /_ ( /_ sin(tx)e— -/ A "dxj dt = r £ ^ I - ^ J <tt 



2 ^ °l rV 

where we have used the integral identity J °° sm(tx)e~ zx dx = t/(t 2 + z 2 ) in the fourth line, which can be 
shown by integration by parts. 

Using the properties of slowly varying functions, for any 7' and 7" for which 7' > 7 > 7" one can find 
constants a\,a2 such that a^ -7 ^ A n > ain r , that is, limsup A„n 7 ja.<x < 1 and liminf A n n 7 ja\ > 1. 
Since f)60[) is increasing is it, on the interval Kg ^ < u < Um, as M — > 00, 

00 

r 



A M (W) > ^/(Kgjf) = ^ 5^ lOg 1 



> 



O B I 2 2 2 I 

„=M \ r K 3,M a M J 

\ r^gU+ ff 2 ^ )dy (61) 



OO 



M 



log (l + (Pmv)- 2 - 1 ') dy (62) 



where 

Pm = 



-1/27' 



r2K 3,M a M 
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Making the change of variables w = PmU, the integral (j52"j) becomes 

^— [ \og(l + w- 2 Adw 

■tPM JMP M V ' 

Equations (|24p and (J25]) together with the choice of 7" imply k 2 M <J 2 f < CM~ 21 for a constant C > 0, 
hence 

/3m < CM -7 ' 77 ' 
for another constant C . Thus, we have shown that as M — > 00, 



Since log(l + 1) ~ .1 as x -> 0, we have 



CM 1 — 1" /1' 



log(l + w 27 



rC" 



7 27 du> 



CM 1 — i r "/f' 

= C" M 1 ~ 2l * 1 '~ 1 '"> 



(63) 



for another constant C" . Notice (|63|) tends to infinity so long as 7' — 7" is chosen to be smaller than 1/2. 
Now, returning to J 2 ,m, (JSTJ) , ([59]), (J63J) , and j26]) imply 



2,M 



< 



exp(-A A /(wj) — 

-1 u 

Um 



f M du 

< exp(-A M (K-] v/ )) / — 

Jk" 1 U 

^ K 3,JU 

= exp(-Ajw(K^)) log ( £K3 ' Aj 

< C" cxp ^"il/ 1 -*'- 1 " 1 ) log A/, for some C" > 



= oiM-^-V' 2 ). 



Estimate for Jm.3- 
For Jm,3, we have 

I -7.no I < 



U M 



cxp 



u 



N 



i+E n 



1 /(w) r 



-K-m,M 



du 
u 



7](N) \m=3 

By bounding all the coefficients of the polynomial in u by their maximum value, we have 



/v 



.M 



m— 3 
N 



t °*(-T)| 1+ £[n*ri(^f 



max 

n(N) 



"m.M 



m— 3 



f(M)-!M!/2 



exp 



"2 



7)(JV) \m=3 



p{u)du 



du 



(64) 
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where p(u) is a polynomial in u whose coefficients do not depend on M. Choosing a constant C > large 
enough such that p(u) < Ce u for all u > £(M)~ 1 M 1 / 2 , we see 



£(M)- 1 M 1 / 2 



exp 



u 
~2 



p{u)du < 



e(M)~ 1 M 1 / 2 

Ce 1 ' 2 



exp 



Ce u du 
e~ w2 ' 2 dw 



^(M)- 1 M 1 /2_i 



V 2 V V2 y 



(65) 
(66) 



where Erfc(-u) = e^dw. Using the fact that Erfc(u) ~ e'^ /{^ku), (d), equation 40:9:2) (J64J) and 

([nU) imply 



N 



\Jm,3,\ < max 

»7(JV) 



m=3 



CJ^Erfc 
2 



n(M)- l M 1 / 2 - 1 
I 71 



O(l)- 



exp(-^(M)- 2 A/) 
^(Af)" 2 M 

Combining the estimates for Jm,u i = 1,2,3, together with Lemma |5. II implies the desired result. 



6 A Numerical example 

In this section, we will demonstrate the utility of the Edgcworth expansion given in Theorcm l5.2l for comput- 
ing the CDF of random variable of the form ([1}. Consider the example where r = 1/2, i.e. r) n is chi-squared 
with 1 degree of freedom, and the A n 's are given simply by 

A„ = Cn~ 3 / 4 

where the normalization constant is C = (2£(6/4)) -1 / 2 = (2 ^Z^Li n^ 6 / 4 )^ 1 / 2 m 0.4375, where £ denotes 
the Riemann zeta function. To compute the CDF of Z = Y^Li KiiVn ~ 1) = Xm + Ym, where Xm and Ym 
are defined in ©, we will proceed in three steps. 

1. Choose a truncation level M > 1. We will see below that M does not need to be too large. Once an 
M is chosen, one must be able to compute the CDF Fx M {x) of Xm , which is a finite sum of weighted 
chi-squared random variables. There arc multiple techniques for doing this, for instance methods based 
on Laplace transform inversion, |20| . [BJ, or Fourier transform inversion, pQ. 

2. Choose an N > 3 and compute the appropriate terms in Edgcworth expansion for the CDF Fy M (x) of 
Ym. For this example, om defined in ©, and the Kk,At's defined in (|2"5"j) . can be computed in terms of 
the Riemann Zeta function: 



-6/4 



M-1 

n 

=Af \ n=l / 

oo / M-1 



a 2 M = 2^A^2C 2 ((2 7 )-^ 

n=M \ n=l 

oo 

2*" 1 (/c - 1)!^/ E A « = ^C* - & f C(*7) " E " _3fc/4 



-M 
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3. The CDF of the sum Z = Xm + is given by the convolution 

/oo 
F XM (x-y)dF yM (y). (67) 
-oo 

We compute this integral numerically in MATLAB using standard techniques. 

We have studied approximations of Ym for various values of M and N. Figures Q] and [5] give a sense 
of how good these approximations are. We look at the Edgeworth approximations to the density of Ym 
and see how these behave as both M and N grow. Figure Q] shows plots of the N = 2, 3, 4, 5 Edgeworth 
approximations to the density of Ym for M = 2, 5, 10 and 20. 

An Edgeworth expansion with values of N > 2 involves corrections to the normal distribution. Increasing 
N improves on this correction. If the improvement is already negligible if one goes from N = 2 to N = 3, 
then the distribution is close to normal. This appears to be the case in Figure [1] for already small values of 
M (M = 10). 

What happens at smaller values of Ml We note that in Figure [T] that even for M = 2, there seems to 
be no change in the Edgeworth correction as N goes from 4 to 5. Hence it appears that for small values of 
M, a high level of accuracy is already reached by N = 5 as it is hard to distinguish the N = 4 and N = 5 
curves. 

For this reason, we will use N = 5 to approximate the CDF of the full distribution Z. Figure shows the 
CDF computed using an N = 5 Edgeworth expansion for Ym for various values of M. Since the resulting 
approximation is nearly independent of M = 2, 5, 10, 20, it is clear that the convergence of the Edgeworth 
expansions is fast for this example. The techniques developed here are used in [19j to obtain the numerical 
evaluation of the CDF and PDF of the Rosenblatt distribution. 
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M = 2 



M = 5 




Figure 1: Edgeworth approximations to the density of Ym for various values of M. We can see that for this 
example, the converge of Ym to a normal distribution is fast as M grows and increasing N beyond 5 causes 
a negligible change in the distribution function. 
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CDF and PDF of Cn^'' 1 (ej - 1) 




Figure 2: Approximation to the CDF and PDF of Z in the case A n = Cn~ 3 / 4 using the N = 5 Edgeworth 
expansion for the tail Ym- There are 4 curves corresponding to M = 2, 5, 10 and 20 in both curves and are 
almost indistinguishable suggesting fast convergence of this method. 
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